Internet Archive's in-browser bookreader "theater" requires JavaScript to be enabled. It appears your browser does not have it turned on. Please see your browser settings for this feature.

Implementing GBIF Pipelines in the Atlas of Living Australia: The first step towards alignment and further collaboration

by: Molina, Javier; Newman, Peggy; Martin, David; Ruiz Jurado, Vicente

Publication date: 2021-9-13
Usage: Attribution 4.0 International
Topics: ALA, data ingestion, biodiversity infrastructure, Living Atlases
Publisher: Pensoft Publishers
Collection: biodiversity
Contributor: Pensoft Publishers
Language: English
Rights: https://biodiversitylibrary.org/permissions
Rights-holder: Copyright held by individual article author(s).
Volume: 5
Item Size: 1.3M

Abstract: The Global Biodiversity Information Facility (GBIF) and the Atlas of Living Australia (ALA) are two leading infrastructures serving the biodiversity community.
In 2020, the ALA’s occurrence records management systems reached end of life after more than 10 years of operation, and the ALA embarked on a project to replace them.
Significant overlap exists in the function of the ALA and GBIF data ingestion pipeline systems. Instead of the ALA developing new systems from scratch, we initiated a project to better align the two infrastructures. The collaboration brings benefits such as the improved reuse of modules and an overall reduction in development and operation costs.
The ALA recently replaced its occurrence ingestion system with GBIF pipelines infrastructure and shared code. This is the first milestone of the broader ALA’s Core Infrastructure Project and some of the benefits from it are a more reliable, performant and scalable system, proven by the ability to ingest more and larger datasets while at the same time reducing infrastructure operational costs by more than 40% compared to the previous system. The new system is a key building block for an improved ingestion framework that is being developed within the ALA. The collaboration between the ALA and GBIF development teams will result in more consistent outputs from their respective processing pipelines. It will also allow the broader collective expertise of both infrastructure communities to inform future development and direction. The ALA’s adoption of GBIF pipelines will pave the way for the Living Atlases community to adopt GBIF systems and also contribute to them.
In this talk we will introduce the project, share insights on how both the teams from the GBIF and the ALA worked together and finally we will delve into details about the technical implementation and benefits.
Addeddate: 2025-06-09 21:49:41
Bhl_virtual_titleid: 210882
Bhl_virtual_volume: v.5 (2021)
Call number: 10_3897_biss_5_74335
Call-number: 10_3897_biss_5_74335
Foldoutcount: 0
Genre: article
Identifier: implementinggbi5moli
Identifier-ark: ark:/13960/s2gmt0rj89f
Identifier-bib: 10_3897_biss_5_74335
Identifier-doi: 10.3897/biss.5.74335
Ocr: tesseract 5.3.0-6-g76ae
Ocr_detected_lang: en
Ocr_detected_lang_conf: 1.0000
Ocr_detected_script: Latin
Ocr_detected_script_conf: 1.0000
Ocr_module_version: 0.0.21
Ocr_parameters: -l eng
Page_number_confidence: 0
Page_number_module_version: 1.0.5
Page_range: 1-2
Pages: 2
Pdf_degraded: invalid-jp2-headers
Pdf_module_version: 0.0.25
Possible copyright status: In copyright. Digitized with the permission of the rights holder.
Ppi: 300
Source: Biodiversity Information Science and Standards 5
Year: 2021